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demands involved in producing summaries, (2) ability to identify task 
important elements in a text, and (3) ability to trawform and reduce 
the full meaning of a text into its gist. Results indicated that most 

of the eighth grade students were aware of the demands of 

summarization when measured against the adult standard. However,* good 
and pbor readers did differ in. what they considered important in a 
text in what they included in their summaries of text, and in how 
they transformed original text. Sensitivity to importance and 
efficient use of the transformations were significantly related to 
the ability to produce summaries. Sensitivity to .importance was also 
significantly related to the ability, to comprehend what had been 
read. The findings suggest that when students encounter comprehension 
difficulties^-teachers should assess, their use of strategic skills 
and provide^ippropriate training. (Materials used in the study are v 
included *J (FL) , . ' - ' 
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4 Abstract 

This -study examined the possibility that some eighth-graders' difficulties^ 
with the task' 6f r summarization may be linked to deficits strategic 
skills* A systematic examination was made of the students 1 introspective 
awareness of the summarization task, ability'to identify impartant>l events t 
in the text, and ability to transform the text into its gist. , - • ( 

Results indicated £hat most of the eighth graders Were aware of the ^ 
taskr demands *of summarization. However, good and* poor readers "did differ, 
in 'what they considered important, in what they included in their summaries, 
•and in how they transformed tfie original text. Sensitivity to importance 
v and efficient use of. the transformations were significantly related to the 
ability to produce summaries. Sensitivity to "importance was"also signifi- 
cantly related to the ability to comprehend what had been read. The study 
suggests that, when comprehension difficUl ties' are encountered, teachers 
sbouldasses^ the students 1 use of strategic skills and provide appropriate 
training- if necessary. - - j 
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'Strategic Difficulties in Summarizing Texts 

In the past few years researchers have b%gun tcxjearn more aboij^t the 
higher-order comprehension problems that may contribute to some c&ilV*eo|s 
frustration with reading. The phrase "highex^order" refers to those 
problems that are not caused by inadequate decoding skills or problems 
in lexical access (Golinkoff,. 1975-76). Recent research has emphasized a 
number of possible sources of such difficulties including those that may 
be r^el^ted to differential language experiences, the lack of prior ^knowledge, . 
or the lack of strategic "ski 1 1 s (Collins & Haviland, 19*79)- l-t is the 
thi'rd possibility, a lack of strategic skills, which-^as the focus of this 
study- « . 

The purpose of this study was to systematically examine tfce strategy - 
differences between good and poor readers as they summarized what they had 
read. Three aspects of the use of strategies were of particular interesjtr 
£af the awareness of thq task demands involved in producing summaries, ^ 
(b) the ability to identify important elements in the text, and (c) the 
ability to transform and reduce the full meaning of; a text into its gist. 
These aspects provided the basis for three experimental hypotheses about 
why poor readers might have difficulty in pfpduci ng adequate summaries: 
-(T) Poor readers- are-not aware that the purpose of s.ubfd^r'izing ^ 
is to copvey the important ideas in a concise manner. 

(2) Poor readers fail to identify £he information which should, 

» 

by adult standards, be included in a summary. 

(3) Poor readers fail touse, o.r use ineffectively, those * 
transformations used by thei r "more fluent peers. ■ t 
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For e'^oh of these hypotheses there were, three goals: <a) to identify 
and characterize possible strategy defici ts .evidenced by poor reader.s, 
(b) to examine the influence that such deficits might have on the ability 
to perform the task of .summarizing,, and (c) to examine the influence that 
such deficits might have on the ability to comprehend what has been read, 
in order to determine whether the use of the "strategy exteods* beyond the 
task of summarizing. « ' ^ 

For'this study the abjlily to summarize, is defined as the ability to 
"convey the main points concisely" (Webster's Third Hew International 

Dictionary, 1964}. The main points are operationally defined ^s those ideas 
' * . '* * . * 

.that were specifically identified as important in a rating or selection task 
"i * •* t 

by fluent adult readers or those ideas that were included most often in 

* , * 

the summaries of fluent adult readers. 

♦ * ■ * * 

Summarization was selected as the experimental ^task for a number of 

• reasons. First, the ability to get the gist of what one reads is of 

paramount importance and many -students experience di f f icul ty'wi th the' task 

•.(Kennedy, 1971). Second, sufficient research has focused on the strategfes 
involved in summarization. to provide the b^ls for a detailed task analysis 

"(Brown S Day, Note I; Kintsch & van Dijk, 1978). Third, although the 
relationship i's unclear, some of the strategies used In summarization may 
also be used "rr^comprehens ion so that ^information derived from studying 

> summarization may inform us about comprehension processes in general 
(Kintsch S van Dijk, 1 978;, Johnson, 1978; Johnston, 1981). ; 

\ The model proposed by Kintsch and van Dijk (1978) .was selected as th* 
conceptual framework for this study since ijt attempts to show how individual 
propositions in the text are transformed and condensed into the gist. 'The > 
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essential components of this model are the'reader's schema, the micrp^ ^, 
structure, tbe" macrostructure, and the macro-rules. According to this 
model, readers progress through a text reducing and organizing its 
mfcnostructure into a macros* ructure through the application of a series of 
transformations known as macro-rules. . 

These macro-rules are not applied ma random manner, rather they are 
constrained by the reader's goals. The readers goals determine which 
elements In the text are' cons i dered relevant | an<5 which ar;© Considered- 
irrelevant. Elements may be assigned relevance according to two criteria 
(van Drjk, 1979). The first is textual relevance in which importance is 
defined 'in terms of what the author considers important. Such relevance is* 
usually signaled tbrougtf various cues in*thfc text structure. The second . 
is contextual relevance, where importance is based upon personal interests 
or background knowledge. Fluent readers are able to make use of both 
textual and contextual criteria so that importance is assigned to elements . 
that are personally relevant and to elements the author intended to be 
relevant. 

The research presented here Is concerned with three interrelated 

aspects of the Kintsch and van Dijk'model: * (a) th§ apprOpri ateness of 

the reader's goals, (b) the identification of those elements in the text 

which &fe most important and (c) •the use of the macro-rules. "These aspects 

were selected because evidence in the literature suggests that these three 

dimensfidns "may be particularly difficul t .for poor readers. 

» 

'' > Fir'st, studies indicate that some children's reading difficulties, 
may.be linked to their confusion about the appropriate goals of various 
tasks in reading (e.g., .Baker S Brown, 1980; Downing, 1979). Most of the 
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supporting research has focused on the acquisition of ( eaftly reading skills 

: f - 
(e.g., Clay, '1969; ;Den#y 5 Weintraub,. T963; . Ehri , 1 979; Johns, 1 980; 

Reid, 1966). Howe*e rework by several researchers (e.g^, Cahney 5 Winograd, 

1979; Meyers & Paris, 1*978) has indicated that, even -older students may also 

be confused about^ some task deminds of reading. Thus, some poor readers 1 

difficulties in summarizing may similarly" be due to their misconceptions 

about the task' demands . , } 

x - * ... 

Second', studies have also demonstrated that good and poor readers 
differ in their sensitivity to importance (e.g.", Dunn, Mathews, Bieger, 
19,79; Eamon, 1978-79; Meyer, Brandt, £ Bli*th, I98O; Smi ley , 'Oakley , Worthen/ 
Campione, & Brovyn, 1 977) * ^However; ■ important questions about the nature 
and effects of these differences remain unanswered. Do poor readers differ 
in a systematic manner from good readers in what they consider important 

1 -4 

in texts? This is an -important question because, to paraphrase Brgwn and 
Smiley (1977), judgments of importance could differ because the poor 
readers have a different conception of what is important or because they x 
lack sensitivity to importance. The relationship between sensitivity to 
importance *and" reading comprehension performance is al so unresolved, The 
issue here M whether or not sensitivity to importance accounts for mdi- 
vidual differences in comprehension beyond that accounted for by lower- 
level decoding problems (Berger & Perfetti, 1977; Perfetti & Lesgold, 1977;' 
Pichert, 1979)' 

- -Third, recent studies (Brown & Day, Note I; Day, 1 980; T-ierney 5 
Bridge, 1979) have demonstrated that good and poor readers differ in their 
ability* to apply the various rules of summarization. 'Here too, questions 
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remain about "the" -nature and effects of these ,di fferences . Which of the 
transformations a\e most difficult? How do differences in the^ability to 
*■ • use the transformations' relate to the ability to summarize what has been 

v * v \ 

read or ; to comprehend what has been read? 

in conclusion, although the 1 iterators Suggests that good and poor 
readers differ along the dimensi6ns of task awareness, sensitivity to 
importance, and use of the summarization rules* many .questions remain 
unanswered. Moreover, no previous study has been, made of a 1.1 three 
dimensions using the same population. Thus, the task of summarizing and 
Kintsch and van Dijk's conceptua \J ramevtork provide a unique opportunity to 
systematical ly^-study the strategic difficulties of poor readers. • 



Subjects 




Method 



' The initial subject pool consisted of eighty eighth graders and forty * 
adults, PoQr readers were defined as those *chi 1 dren who scored below the 
♦ 50th percentile on the Reading Comprehension Subtest of the Stanford 
Achievement Test, -The^mean score .on this test for the poor readers was 
26 3k (SD = '9,84). Good readers "were .defined as those children who scored 
above the 59th ' percent i le on the same test. The mean score on this test 
for the good readers was 66.28 ( SD * 9*59). The adgKs were all associated 
wjth*the University of Illinois, aither^as undergraduates, graduate 'students 
or recent graduates at the doctoral level. Absences and incomp+ete data 
sets reduced the fi*nal numbers to thirty-six poor . readers thi.rty-ni nfe 
good readers, and thirty-seven adults. 
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Materia Is 



The first set of materials consisted of a series 'of multiple-choice 
and short answer interview questions designed to assess the subject's 
knowledge about, the task <3f summarization*. Questions #1 thraugh #** were 
asked before any of the other experimental tasks were administered. 

(1) How often are you asked to summarize what you read hi school? 

(2) Has anyone ever 'taught you how to summarize what you read? 

(3) if the answer to Question #2 is yes, what did they teach you 
to do? 

(k) What does it mean to summarize an article? 

- * 

The next three questions were asked after all the tasks, were completed. 
Question #4 was repeated in order to assess any possible effects o£ the 
•experiment itself. 

(5) What does it mean to summarize an article? 1 

(6) List at least. 3 ways you decide which ideas from the article 
should be put in a summary/ 

" {7) ' List at least 3 ways that your summaries £re different frc>m 

the original articles. 

The ne*t set of expeYimental .materials consisted of eight expository * 

passages adapted from trade books and elementary social studies* science, 

an£ reading* texts (Education Development Center, 1970; Ginn Basic, Reader, 

1967; Holt Databank System, 1976a, 1976b; Noble z Noble, 197^; Wright, ^ 

* 1971). All of the passages Were approximately *equal in word length 

* * * » 

(M = ?>kk, SD = 18.35) and. they "ranged from the-upper third'grade to the 

lower sixth, grade in difficulty (Fry, 1977)- 
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The eight passages were the basis for several 'of the-ether experi- 
mental materials."^ First, a five question jnul ti ple-chpice test* was 
developed .Jor each passage. All five questions were designed.to test 
comprehensioa of speci fi c. information in the*passage. The stem and thejj^ 
dbrcect answer-were taken from information explicitly stated in the tex-t. 
^ Next, a word list was 'developed which cchtaine^d 100- randomly 'selected 

unique words from the passages (excluding proper nouns). This list wafe 
* » 

designed to provide decoding rate.and accuracy measures for each of the , 
eighth-grade subjects. ♦ j 
' * The lest set of materials was developed by taking each passage and 

simply listing i t <s individual sentences. The sentences were* then numbered 

* * » 

consecutively aryi each was followed by' a five point rating scale so that 

the.subjects* cou^d rate how' important the sentence was t& / the to tal -passage 
Procedure 

Each of the eighth* graders was randomly assigned to one of four equal 
sized groups with the restriction of having equal numbers" of good and poor • 
readers in each group. The order of the passages was counterbalanced for* 

each group. » . - . . . 

The initial data on the eighth graders were c&l 1 ected in two stages 
over a three week period. Each Child was involved in approximately eight 
sessions which usually ran about forty minutes. in length. During the first 
Stage, the* children were individually tested to obtafn measures of their 
decoding, accuracy, and speed. During this time they also answered the first 
set of written interview questions and completed the fPAT Culture* Fai r IQ 
test (Cattell SCattell, I960).- / . 
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During, the second stage, tffe eighth-grade students completed the m 

majority of the'experi mental tasks. The general order of the tasks was 

t * " * 

v the same for all of. the eighth-grade subjects. First, the children read 

\ * * 

arkarticle and recorded thej r reading time. Next they answered the five 
multiple -cho ice questions without access to the article. When they had- 
f in ishedv answering the questions, they wrote a sixty \pfd sdtomary of the 
article. They were given access to the article wh'ile.they were writing r ■ 

*v \ * * 

the summary. Vol lowing a brief interpolated task, the subjects rated the 
relative importance of 'eacTi sentence to the passage as a whole. DurMng - 
the final 'task, the\suSjects turned, back to the numbered sentences and 
selected ttje^five mosK important sentences in .the. whole article. 

.After the lastjstepV the chi 1 dren -Were 3i\>en a fev/ moments "to relax 
before going, on t^/the next\passage and repeating the process. Each chi ld 
worked with a total of six of\the eight* passages***^ equal numbers of ; 
subjects' read each of the eight\>assages . In addition, the summarization 
task and 'the. rating and selectionVasks were counterbalanced so that the 
children summarized and then identified importance for the first three 
passages and theh reversed the order f\r the last three, passages. ■ When 
the firtal summary had been wri tteji , the children answered the Gaining 
questions far the task awareness i nteryi ew\^ Al 1 answers to the questions 



were' wri tten. 



Six months Jater,- the final data were collected on a subset of the 
good j(N =-T2) and pbqr (N 12) readers. These, children were asked to 
rate and select the important information f.rom two passages they hacl ^ . 
•encountered earl i er.^ The purpose of this 'final task was to obtain a measure 
of, the long-term reliability of the, chi ldreh's importance ratings. 

' I ■ M - — ' 1 ^^^^^^^^^ 
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The dat>a or^ the adults WeVe collected during a single two hour session; 
Each adult worked with all eigitf passages ar^d all of the tasks were the 

same, except that they were not given the IPAT Culture Fair 1Q test,, the 

*^ 

decodjng measures, or thedelayed importance rating task* 

• Scoring* the Summary Protocols ' , « 

* * • 

The summary protocols were scored using a system which made it possible 

^to ^identify which ideas from the original passage were included in the 

summary, as well as to record 'what transformations^*^ been performed on 

those ideas. Fourteenfkinds of transformations were, identi f ied 'in the„ ♦ 

summary protocols. These fourteen transformations were then collapsed into 

four broad categories: reproductions? comiri riati ons ^ run-on cQmbinations, 

and inventions. * , 

•■•*"' ' ) 

Rep roductions refer to instances where subjects reproduced individual* 

: * a . * ; ' 

sentences in the original passage, usually through the use of paraphrase. 

o^word for word copying. . Combinations Were transformations where subjects^ 

had combined two or more sentences in the original passage into one sentence • 

in the summary protocol. An exaqpple from /one of the adult's* protocols was: 4 

The river otter is'very'much HKe the sea^otter but.it is, 

smaller, eats fish, frogs, and, snakes, and/travels overland. 

* « 
» * * * 

'Run-on. combinations' refer tp instances where elements from several sentences 

* ■ : 1 — ■% 

in the original passage had .been included in the protocol but in a less 
organized fashion than those transformations scored as combinations. This 
category was developed because, it was necessary -to distinguish between well- 
formed combinations and those produced by subjects who included words, in a 
less organized yet 1 i near, fash k>n across, sentences , An example from one of 
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the summaries produced by ;a poor reader will help clarify the distinction 
between run-on and regular combinations: 

* Sea otters' have low bodies short legs tails are thick and flat 
"shape' he-lp them swim deep they eat from the sea eat fish frog 
snakes in water river otter smaller and not so heavy bend front 
' legs and push back play slide down <the river'bank. 

Inventions refer to instances where .subjects prodded . individual sentences 

which conveyed the meaning of a paragraph, several paragraphs, or even - the 

whole passage. l/fiNe these sentences 7 did relate to the passage, it was very 

difficult to tie them to anyspecific elements in the surface 'structure of 

the original sentences. These inventions were often topic sentences which 

. covered the information .in a general W^y. t - , 

.As a check on the reliability of the; scoring system, a second rater, ; f 
checked* 20% of the /summary protocols produced by the three groups. • The 
reliability figures for identifying which ideas in fhe original passages 
were included in the summaries were: .96, for the poor readers, for. 
the good readers, and .89 for the adults. The' inter rater reliability figures 

-for agreement over which of the fourteen subcategories of transformations 
had been used was slightly-less: .93 for the poor readers, '.91 for the 

4 

good readers, and .84 for the adults. 

This .scoring system differs from others currently in use" (Brown- 6 Day, 
Note 1; van Dijk, 1977) in a number of ways. The most important difference 
{5 that, in this system, transformations were categorized simply on the basis 
df how the original information was modified to produce. the summary. No 
•decisions were made, at. this point, about the relative importance of the 
information that. was modified as Brown and Day (Note l) and van^Dijk (1377) < 
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have done. For example, Brown' and Day (Note 1) use the .term Invention to 
refer to^the production of a topic sentence for a paragraph whiqh lacks one. 
(n the present system, however, ndr determi nat ion was'made abtfut Whether or 
' not the transformation has resulted in a new topic sentence. The new 
sentence was scored eithef as a cQmbination or as am invention depending on 
whether or not its elements coulci be linked to specific elements in the 



\ 

original passage. 



* Although the scoring system used in>this study' draws heavily upon the 
work of van Di X k 0.977) and Brown and Day (Note 1), it "is simpler to use on 
summaries prpduced fronnr natural ly occurring texts because raters have only 

to- decide which transformation has occurred. Later, in a separate analysis, 

* * * 

decisions can berttade about the relative importance of the information which 

♦ 

was modified. 



I 

Results • 

; * • 4 



Analyses were performed* on three sets of data. The f i rs't set consisted 

of the subjects' responses to the interview questions. The second set 

. ' . 

Consisted of the subjects 1 ratings and selection of the important items in 
the eight passages. The thi^rd set consisted of the. summaries themselves. 
Major findings are summarized below. 

Fisher Z transformed correlation coefficients were used in all appro- 
priate analyses. However, untransformed correlation coef f ilciyts are 
reported to ease communication and interpretation., Post -hoc tests were , 
Scheffe' with a significance level of ,05. Tests of simple main-effects 
were performed for all significant interactions using the procedure' 
recommended by Kirk (1968). Iri particular, the significance levels were 
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determined by dividing the\ overall alpha for the main-effect test evenly 

* * * » 
* among the collection of simple main-effects? tests. 

Task Awareness 

All subjects were asked a series. of questions in an Attempt to assess 
their awareness about the task of summarizing. The first two questions were 
multjple choice and were easily analyzed. For all the open-ended questions, 
the answers were analyzed by identifying responses given by more than orte 
subject and then rank ordering those responses by the proportion of subjects 
who produced them. These r.ank-o/dered responses , were then further examined 
using the Goodman- Kruskal tau (Blalock, 1579). 

Detai l.s -.regarding the subject's responses to i ndj vi c)ual questions can 
-be found in Winograd (1982).- However, 88% of the poor readers, 32% of the • 
"goo'd readers', and 89% of the adults claimed that- they are ap least sometimes 
asked to produce summaries in school. Irt addition, Jh% of fche. poor readers, , 
* 72% of the good readers, and 5**% of the adglts reported that they had been' 
taught how to summarize. , , 

Recall that the question, M What does it mean to summarize an aVtlcle?", * 
was asked twice in order to assess ^ny possible effects of th6 experiment 
itself. The rather small changes in the proportional reduction of error 
between the first time and second time the question was ask6d indicated a 
relatively stable response pattern. ^ 

. The analysTs most pertinent to this study was conducted In the 
following manner. Theoretically, the most salient feature of a summary 
is that it'Contains the most Important ideas jn the original passage, 
therefore, if a subject explicitly mentioned important points or main ideas 
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at least once in a response to any of the questions, he or she was assigned 
a score of 1 indicating an awareness of this aspect of summarizing. If the 
subject never explicitly made reference to importance, but made more vague 
responses about what the article, was. about, he or she was assigned a score 
of '2. This distinction was made so that i t- was possible to see if the more 
explicit reference to importance was an indication of a more developed 
metacognf five awareness of , the tas^k "demands i If a subject never referred 
to importance or what the passage. was about in response to any of the 
questions, he or she was. assigned a score of 3-' These scores are based on 
a nominal scale and were later used in multiple regression analyses to „ k 
examine the possible effects of^task awareness on various dependent measures. 
Results indicated that t>3% of the poor readers pnd 69&' of the good 
/ " readers were assigned response level scores of 1. Another W% of the poor 
readers and 28^of the good readers were assigned response level scores "of 
2. The remaining children, \h% of the poor readers and 3% of the good • 

A. 

readers, received response "level scores of ^. Since so many of the students - . 
made- explicit reference's to including important ideas as an aspect of 
"~~ • • .summarizing or at least stated that a summary indicated what the article 

was about, it can be concluded that confusion about the .task goal was not a 
major problem for these eighth graders* , , * 

* • It should be noted, however, that the task used to collect the data ' ^ 

(written interview questions) can only measure task awareness on a crude 

' , sca % That ' s tp ' sayj although most of £he cnildre \ indicated that ; they ^ 

knew what thfe general purpose of a summary was, a more sensitive measure, 

* 

■ may have detected subtle differences'^ the children's level of task 
awareness.' / ' 
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- Sensitivity to Importance 

The next set of analyses examined the subjects 1 abfiity to identify 

the important e lemehts ; in the passages. Correlations were computed between ( 

the various Sxperimfental tasks at the wi thin-i ndl vidua 1 level, between the 

individual and the aggregated group, and at the aggregated §roup level. 

Since ,the pattern df results was similar acro,ss all levels, most of the 

correlations discussed in, this sectiorr^are those computed between at the 

aggregated group Ifeve] . ' ( t 

/ I * , 

A preliminary comparison of the distributions of the poor readers 1 

ratings with the distribution of the good readers' ratings indicated that 

both groups vfere using the full range of the. f iye point rating scale and m 

» - v 

that the shapes oil" both distributions approximated the normal curv£. 

; ' - 

Moreover, the within-subject variation for poor readers wa£ about equal te^ 
rHat of the good readers. For example, after a six month lapse", the test- 
retest* rel iabi 1 Ity coefficient for the poor readers equaled that of the 
good readers* The mean correlation between individuals' fi rsf and second . 
ratings was SZO for both good and poor readers. Other evidence comes from 
point biserial correlations computeS between each individual's importance* 
rati'ngs and importance selections. The mean point biserial correlations 
were .524 for'the poor^ readers ,.. 485 for the good readers, and .567 for 
the adults^ Thus, given that .the poor readers had made some judgments 
about the relative importance of the ideas in the. passages and that these , 
^judgments were somewhat consistent, the issues surrounding poor 'readers' 
* sensitivity to importance could be addressed." * * ■ 

.The first major finding from this set of analyses was not. unexpected: 
Good readers were better judges of impoctance than were poQr readers when 

e±; ; ;V .. ; .. is ' ■• ' ; - 
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that importance was defined in adult terms. Consider first the correlations 
computed between each group's mean importance ratings which are presented 
in Table 1. The correlation between the poor readers and. the. adults is .459; 
between the good readers and, the adults' it is- .708. The correlations, between 
the good and poor readers 1 mean importance ratings and the. proportion of 

adults who selected the sentence as one of the most important reveals a 

«j » 

similar pattern. Poor readers agree less with adults (-353) tharj do good 
readers (.625) • 

Insert Table 1 about here. 



The second major finding was 'that a 1 though poor^readers 1 judgments 
of importance were not highly related to those of adults/ poor readers 
did show some consistency irr what they considered important. Some of the 
data to support this conclusion come from the correlations which were' 
computed between the individual's ratings of importance and the mean ratings 
of importance of his or her peers. The mean correlations are .337, ,.370, 
and .616, for f the poor readers , .good readers, and adults, respectively. 
Consider also the correlation between each group's mean importance ratings 
and the proportion of that same group who 'selected the sentences as one of 
.the five most important. These coefficients, ^which are presented In Table 1, 
pre .770 for the poor readtrs, .808 for the good readers, and .838 fQr the 

adults. * 

Theeviden^e argues strongly that poor readers- In the eighth grade 
are not idiosyncratic in their judgments of jmportance; Given that poor ^ / 
readers have some consistent ideas about what is important in texts, the 
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next question is, "What kinds of information do poor readers consider 
important? 11 . f 

In order to answer this question, a set of sentences which poor readers 
tended to select as important but which adults and good readers did not 
was identified using the Chi-square test. This analysis revealed signifi- 
cant differences (£ < .05) between the groups for srxty-five (29%) of the* 
two hyndrfed and twenty-four sentences in the. eight passages. These sixty- 
f4/e sentences could be classified into four groups: (a) sixteen sentences 
selected by more fluent readers (good readers and adults) than by poor* 
readers, (b) seventeen sentences selected<by more children than adults, 
(c) seventeen sentences selected by more adults than children and, 4 
(<j) fjfteen sentences selected by more poor readers than fluent readers. 
These last fifteen sentences are the most pertinent to this study. 

In examining the sentences chosen most often by poor readers, it is 
difficult to identify one overwhelming characteristic. However, the 
sentences do provide'a sense of what appeals to the interests of the poor 
readers in this study. * Consider, for example, the sentences selected by 
significantly more poor readers in the article entitled Cities in the 1800's . 



Insert Table 2 ahout here. 



It would appear that these sentences are full of highly visual detail. It 
seems that for poor readers, importance may have been based on factors which 
captured their interest. In contrast, significantly more fluent readers 

* 

choose the sentences marked by a asterisk. Fluent readers seem to be 
defining importance more, in terms of textual importance. 
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A third major finding^as that the relationship between "the information 

that poor readers judged to be importarrt and the information that they 

included in their summaries was not very strong. That relationship wa^r - * 

stronger for thegood readers and stronger still for the adults. Some of 

the evidence for this conclusion comes from point-biserial coefficients 

obtained by correlating each individual's importance rating with a 1 or 0 

• depending on whether or not*the ideas in that sentence were included in that 

individual's summary. Other evidence comes from phi coefficients obtained by 

t ' 
* ■ , * * * * ? 

correlating the di chotomous. data for summary inclusion with the dichotomous 

, • • ■ • * > 

data for importance selection v(l or 0 depending on whether or not the 

sentence was selected as one of the five most * important) . The point- 
biserial coefficients are .097, .1*61, and .357, for the poor readers, , good 
readers, and adults respectively. The phi coefficients are .087, .155, 
and .331 for the poor readers, good readers* and adults respectively. 

'Still other evidence corpes from the correlatipns presented iryTableJ, 
The correlation between the poor readers 1 ratings and the poor readers 1 
freguency of including information in a- summary ifc .186. Thq parallel 
coefficients for the ^good) readers and 'the adults were much higher, .598 
and .750, respectively Thus, while poor reatiers showed a level of 
consistency among themselves in what was regarded as • important that 
approached that of. the good readers, this level of judged importance "had 

much less influence in determining what»poor readers included in, their 

» 1 _ 

summary. . , * J ' • * 

c % 

The preceding resul ts. rai se the question of why the correlation 

• > • * ' « ' * 

between importance and summary inclusion should be so low for poor readers. 

fn order to answer this question,, several analyses were performed. The 
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first examined the possibility that serial position effects Jiad a strong 
influence. on which i^eas were included in the summaries. The sentences of 
each-passage were divided into quartiles on the basis of their serial / 
position with approximately equal numbers of sentences in each quarti lp. 
Next, the proportion of ideas included in tKe summaries was determined for 
each quartile. The results of this analyst afr& shown in Figure K 



Insert Figure 1 about here, 



The fluent adult readers display a characteristic curve which indicates ^ 
that over a. thj rd (.3*0 of the ideas in their summaries came from, the first 
quartile, then decreasing amounts from the* second/(.23)' and third (.18) 

'quartiles, and then* an increase in the final quartile (.23)*.. This curve 
is almost identical to the one obtain3d by- Kintsch, and Kosminsky (1977) in 
their work with summaries produced by college students. Gotfd" readers^ tended 
to approximate the pattern produced by adults, but with les^s tendency to 

* include information from the end of the passage., their proportions for 
the four quarti les were -.35, .26, .20, and .f.7, respectively. 

Contrast the adult and good readers 1 curves with that produced by N 
the poor readers. Poor readers get almost half (Ah) of their ideas from 
the f i rst'quarti le, tljen steadily decreasing amounts from ttie second (<25) 

'and third (.16) quartiles. Poor readers get^ ,13 of their information from 
the final quartile whereas adults get .23 and good readers get .17. 

♦ Given these patterns for inclusion^of information in the summaries, 
it is instructive to look at a parallel analysis w^hich examines serial 
position effects on which ideas, the subjects selected as being the most 
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important ones in the passages. These results are displayed in Figure -2. 
Again, note the characteristic curve for both the adults and good readers. 



; tf 

Insert Figure 2 about here. 

The figures for the four quartiles for the adults are: .35, .22, .19, and 
.22. For the good readers, the figures for the four quartiles are: .29, 
.22, .21, and .24. The poor readers, however, selected about a quarter of 
their- ideas from each of the four quartiles. 

When the -data displayed in Figures Land 2 were subjected to a 3 (Group) 
by h (Quartile) repeated measures analysis^ variance,' s i gni ficant. effects 
were^ound^for both dependemr^arrabhes^ Wien-the dependent variable-was- 
proportion of ideas included jn the' summary > the Quartile effect and the 
Group X Quartile effects were'both significant, £(3,327)^ = 8^.59, 
p< .0001, and F<6,327) = 6.81, p_ < .0001, respedti vely. When the dependent 

variable was proportion of important selections, the Quartile effect and \- 

> * * « 

the Group X Quartile effects were both highly significant-, £(3, 327} = 
lit. 75, £ < .001 , and £(6, $27) - 3-97, £ < -001 , respectively. Specific 
details on the tests of simple main-effects can be found in Winograd (1982). 

Thfese data suggest that poor readers are using two unrelated strategies; 
'one for>deciding what should be included in the summaries, and another ,for 
selecting which sentences are the most / i mpdrtant. The patterns produced, 
by the good readers and .adults, however, suggests that' they ,are using, 
'their sensitivity to importance to guide them'jn both the inclusion and 
selection .tasks. 

.this Interpretation of the data is supported by* further analyses. The 
individual ! s mean Importance rating for the ideas in each quarter of the 
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passage that he^or she included in the summaries was computed. Next, each 
individual's mean importance rating for the ideas not i ncl uded. was computed 
for each quartile. These data are given in Table 3- , Adults consistently 



Insert Table 3 about here. 



include, in their summaries information that they rate as important. Good 
readers al so 'i nc|uded information that they . rated as important , in their 

summaries, and they deleted the information that they rated as less important. 

c * > 

Poor readers,; in contrast, choose higher rated informat ion to include in * 
their summaries only in the first three quartileV. As they progressed 
through the passage, the mean differences between the rating for inclusions 
and^eletioris became smaller and smaller until, in the last quar v tile, 
the Information included in the summaries had a mean importance ratiag 
below that given to the information that was deleted, 

.These results are further evidence that fluent readers do rely on 
their sensitivity to importance in order to construct summaries. Less ' 
fluent readers, however, show much less consistency between what they 
include in a summary and what they rate as important. In addition, poor 
readers are much more prone to the adverse effects of serial position. 
That is to say, poor readers include less information from the latter ^art 
of the passage in their summaries and that which they d6 include Is less 
important based on, their own judgments. * 

« 
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Use of the Summarization Rules * 

The third set of analyses examined the possibility that poor readers.^ 

■* 

• 4 1 

f «• * 

failed to use, or used Ineffectively, those summarization rules used by 
their' more fluent peers. 

Preliminary analyses revealed that the three groups did not differ 
in the number of "tfords ^they used in their summaries, £(2,109) = 1-2,, 
p > .1. They dPd, howevdr, differ significantly in the proportion of ideas 
each^aeleted from the original passages, F(2,109)> = 10.39, £< .0005- Post 
hoc .tests revealed that, the good and poor readers deleted significantly 
more of the original passage ideas, than did the £dults. Jhe mean proportion 
of original passage ideas deleted by the^^oot^readersr^o^^eader^ir-anrd ; 
adults were .78, .78, and .72, respectively. These data are an indication 
of the adults 1 superior Ability to convey more ideas without using more 
words. Furthermore, the fact that the good and poor; readers do not differ 
in the number of ideas deleted makes the comparison of which' ideas are ^ 
included more interesting. 

The majors finding for the thKrd data set was that there were clear 

^developmental' trends in the use of each of the rules. > This pattern is.* 

■ *> 
clearly displayed in Figure 3. The pVoportional means for the adults' were 

" .64, .11, .2S, and .00 for combinations^ inventions, reproductions and , 
run-on combinations, respectively. Fof the good readers, the means, were 
.38, .0(5, .39, and %i if. For the poor readers they were .25, .0k 9 .A8, and 

a. 23. Note that increased reading skill led to fewer reproductions and 
run-on combinations and more combinations and inventions.. 
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This pattern was confirmed by statistical tests. A 3y (Group) by k 
(Rule Use) repeated measured anal ysi s produced sign? f icant \ffectsP?or 
'•Rule Use and the Grc>up'X Rule Use interaction, £(3,327) - 60.99, £< 
V.0001, and F(6,327) = 15. 1 B , £.< .000>, respectively. Follow-up test's 
indicated that poor readers used significantly fewer combfrfations thanpciid 
good readers, £(2,^36) = 35.5, £ < .005- This is important because combi- 
nations were the dominant transformations used by the adults. In addition, 
while the differences were not significant, developmental trends were 
evident in each of the pther rules. The. hypothes i s that poor readers fail 
to use, or use less effectively, those rules used by more*flu,ent readers 



has been, supported. 

The Link Between. St ra<efay Use and Performance , 

The last set of an^lyaes examined what influence differences in 
Strategy use had on the ability to perform the task of summarizing and on 
the ability to comprehend what has been read. Hierarchical multiple 
regression (Cohen & Cohen, 1975) was used *to construct and' test a model 
using summarization and comprehension performance measures as the dependertt 



variable. Since'hierarchlcal regression qssumes that variable's are entered 
into the equation in a theory-governed manner, 'some explanation fdr the 
order of the variabl es is required 4 . 

» 

The first variable entered into 'the equation was the IPAT -Culture 
Fair IQ. score. This measure of nonverba-1 10. was included to account for 
the possibility that differences in performance were mainly due to 
differences, in intelligence. • , , 

r ■' ■ ■ 
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Speed and accuracy of decoding were the n£xt variables to be entered 
Into the equations. .These two measures were obtained for each child when 
he or she read the word list aloud to one of the experimenters. Speed of 
decoding was the time in seconc^Jt took the child to read al 1 'one-hundred* f 
words. . Accuracy of decoding was simply tRe, number o.f words missed. 
' Decoding speed and accuracy were entered second # and third because theoreti- 
cally ^ey are a necessary prerequi si te. for comprehension. In addition, 
^coding ability is often cited as the major source of^Jndi'vi dual 
. differences in comprehension.' The fact that IQ and decoding ability are 
entered before the variables of interest and are allow^to account' for, 
as much of the variance'as possible provides for a stronger test of the * 
hypotheses presented in this study. 

O' The fourth and fi fth variables in the model were orthogonal contrasts 
based upon the level of .response given to the interview quest ions .defl ing 
with task awareness. The first contrast comparad Response level 1 with 
^Response Level 2 and the second compared Response Levels 1 and 2 with 

Response Level 3* ' > + J ' • 

* ** . * • j 

■ * _ \ 

The sixth variable entered into the equation-was a measure of each 
.child's sensitivity to importance. This measure was obtained by computing 
the correlation between that, individual 's ratings of importance and the* ^ 



' . mean adult ?StTngs~xrf--tmport,ance^ * . { . 

' * * ' ' . . • * *. 

The seventh variable in the model w£s a measure of effective rule \ 

* - * • 

(' . U se. This measure wasi obtained by computlng'the proportion of combinations 

and inventions out of the total transformations each Individual used.. 

*' ' » ' * 

Since fluent adults tended to use these two kinds of trans format ions most 
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, often., it was thought that children who used a higher proportion of 

combinations and inventions were exhibiting a more mature pattern of rule 
use. '** v - . 

The remainder of the variables entered into the equations were twoj^ 
way interactidns between each of the' main effects. r * . 

The order of the variables measuring task awareness, sensitivity to 

importar^je, and rule use was based -on' the comprehens i,qn model^ presented 

' **» * 

by Kintsch^gn^van Dijk -(1978, p. 3*72) . They stated that: 

The' reader's goals in reading control the application of the 
macro-operators. The formal representation of these goals is 
- the schema. The schema determines which micropos i tions or 

generalizations of microproposi tfons are relevant and, thus, 
which parts of the text will form its gist. 

? For the purposes of the regression analysis it was assumed that a fluent 

! -rfeader comes to the task* with the awareness that, to summarize an ^article 

is to reduce it to its gist. Next, he or she identifies the ideas to be 

included, and by necess'rty those whiclj can be deleted. Then as the reader 

identifies elements as relevant or irrelevant, the macro-rules are used*' 

to transform the passage into a summary. , 

'Now that the rationale underlying the model has been discussed^ the- 

results can be presented. The fir'st regression equation examined the ■ 

relationship between strategy di f ferences^and the quality of the children's^ 

summaries. The measure selected to assess the quality of each ch i 1 d 1 s 

^ summary was a summarization score obtained by computing the point-biserial 

correlation between the sentences the child included in' his o.r her nummary 

and the proportion of adults who also included the sentences in their 

summaries. Thus, those children who .included sentence^ in their summaries 
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that'were also included by a higher proportion of adults would.bave 
correlations approaching 1. Conversely, those children wftose summaries \ . 
were based on sentences not. included by a large proportion of ^adults'would 
have correlations approaching 0. * "C^" 

. 'The results f rodf the hierarchical regression equation using this 
correlation as the dependent* variable are given in Table The IPAT 
Culture Fair IQ test accounts .for a significant proportion of the variance/ 
16.94%. Neither of the decodirig-measures reached significance, nor did 
either of the contrasts involving the level of task awareness. Sensitivity 
to importance did account for a sizeable proportion of the variance, 16. A%; 
Proportion of effective rule use also accounted for a significant proportion 
of the variance, k. 15%. None of the interactions- reached significance. 



Insert Table k about here. 



The second regression equation examined the relationship between 
strategy differences and . comprehens ion of the passages, These data are 
given in Table $. The dep^ident variable is the. average number of multiple 
choice questions the children answered correctly. The IPAT-<ai1 ture Fair,IQ 
test accounts for a significant proportion of the variance, 9. 36%. 
Accuracy of decoding also .accounted' for a significant proportion of th&- 
variance, 4.98%., Nei ther. contrast involving level of task awareness 
reached significance. However, the next variable,' sensitivity to 
importance, accounted for 5^3l% of the variance. Effective rule use 
accounted for an additional 3. 55%. of 'the variance, a proportion which- 



approached significance* 
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Insert Table, 5^ about here* 

Jwo Interactions did reach significance. The I PAT I Q X Decoding* 
Accuracy interaction accounted for 6.27% and the Decoding 'Speed X Response * 
Level Contrast 2 accounted for 5*80% of the variance. An examination 
of these two interactions Indicated that they were probably the < rfcsul ts 
of ceiling effects since most of the children did very well on the multiple 
choiqe questions. This was certainly the case for the -IQ, X Decoding 
Accuracy interaction. -However, the interaction between Response Level 
Contrast 2 and Speed^of Decoding did produce an interesting finding. An 
examination of the data revealed one outlier; who was' almost two standard 
deviations above (slower than) that group's mean for speed of decoding 
and whose responses to the interview questions indicated that he thought 
that to summarize* an article meant to memorize it. Apparently, this 
subjects view. of the experimental task and his Slow speed in decoding had 
interacted to such an extent that answering the comprehension questions 
at the end of the passages became very difficult. His mean comprehension 
score was 2 out of a possible 5 'when the average for all subjects was 

4.02. ' . 

The last regression equation exami.ned the relationship between strategy 
differences and a dependent variable with no restriction on range — the 
children's score on the'Reading Comprehension Subtest of the Stanford 
Achievement Test. These results^ are reported in'Table 6. The IPAT (f&lture 



Insert Table 6 about here. 
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*\ Fair IQ.test accounts for a large proportion of the variance, .20.082. In 
. contrast to the results of the previous regression analysis, speed of ■ 

' / - 

decoding, not accuracy of decoding, accounted for a significant proportion 

< • 

of the varPance, 8\7I%. Neither of the contrasts involving level of task 

awareness approached significance. However, sensitivity to importance did 

■ * 

account for a significant proportion of the variance in £he children's 
standardized reading scores, 5.k%, which was af>out the same proportion of 
thevariance that sensitivity to importance accounted for jn the regression 

analysis with passage comprehension as the dependent variable. Neither 

* * 

effective rule use nor any of the interaction^ achieved significance. 

'.In considering the results from all three regression. equations; the. 
most striking result is that the ability to identi fy' important elements 
in a text accounts for a significant proportion of thevariance in all 
three dependent measures even after IQ and decoding ability are taken into 
♦ account. This is strong evidence that .higher-order comprehension diffi- 
culties may be linked to strategy deficits. This also indicates that the 
ability to identjfy important elements in a text is a strategic skill that 
.underlies b6th comprehension and summsrizatjfcn. 

Second, effective use of*the rules seems to be ^strategic skill that 
is more task specific. That is t6 say, the abJ-Uty to rfcduce a passage, 
into a summary through the use x>,f ^ft£~~tHJns format ijbns identified in this 
study does not rel'ate ;signi ficantly to the. ability to comprehend that 
" " passage. This conclusion is based on the fact that rule use only accounted 
for. a significant proportion of the variance tn the regression which used 
the summarization score as the dependent variable. 
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ThiYd, for the most part, task awareness was pot a significant problem 

in either producing summaries or understanding what was read. This is 

not surprising given that most of the children revealed, that they were * 

* 

aware that one aspect of the task of summarizing 'was to include the main 
idea. Jhe non-significance of the task awareness fattor also emphasizes 
the importance of linking measures based . on introspective data to measures 
pf performance (Ryan, 1 98 1 ) . I,t otherwise would not have been difficult to 
asswru^^ in the explidtness of the children's responses nlay 

have been indicative of underlying strategy differences. 

r v / Summary and Conclusions 

Overall, the data did not support the first hypothesis that some poor 
readers 1 problems with summarization stem from confusion about the demands 
of the task. Results indicated that most eighth graders in this study 
knew , that a summary shpuld include the important ideas from a passage. 

The results also indicated that the level of. explicitness Ln their definitions 

* x * 

of summarizing was related little, if at all, to their performance in 
understanding or summarizing a passage. It is worth repeating, however, % 
that a more sensitive measure than written interview questions might. have 
resulted in a different conclusion. • ' * 

The data did support the second hypothesis that some poor readers 
have difficulty in identifying the information that adults consider 
important. Good readers were more in agreement with adults in their 
conceptions of importance than were poor readers. Podr readers were, 
however ^, qb out as consistent in their judgments of importance as were good 
readers. Thus, the problem was not that poor readers were idiosyncratic 
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and Jacked sensitivity to importance, but rather, that poor readers had 
different views about which ideas in a text were, .important. 

Based on these results, .one can speculate that fluent readers were ^ 
able to identify importance based on judgments of contextual . and textual 
constraints- In other words, even though they may have found some 
passage elements important because of their particular interests and 
backgrounds, they were also able to identify yvhat the author considered 
important through the use of textual cues- In, contrast, the less fluent, 
readers were more likely to base their selections of important information 
based on contextuaUponstraints only. The kinds of information they chose 
as important seemed to be those that were of high personal interest, not 
the kinds of information the author staged as more important irr the 
passage- An important goal for future studies^ will be to identify more 
specifically the factors that influenced the poor, readers 1 choices- 

Another striking difference between good and poor readers was the 

degree of relationship Between what the subjects identffied as important^ 

and what they included in their summaries* One explanation for the low" 

correlations for the poor readers is that the fluent readers were 1 incl udi ng 

ideas in their summaries based on what they perceived to be important 

throughout the passage, while the poor readers* 1 .Choices of which ideas 

to include were adversely affected 'by serial position* It may be that, : 

as the poor readers proceeded through the passage and the processing load 

became heavier, they became less adept at using their perceptions of * 

importance to guide them in choosing which ideas to include"* i;n their 

* 

summaries* ' 
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Another Important finding concerning sensitivity to importances was" 
tHat It accounted for significant proportions of the. variance in the 
stroma rizat ion scores and in both measures of comprehension ability even 
after differences in IQ and decoding ability were taken into account* 
These results provide reasonable evidence that higher-order comprehension, 
difficulties may be linked to strategy deficits. These results also indicate 
that the ability to identify important elements in a passage' is a strategic 
skill that underlies both summarization and comprehension* 

Consider why sensitivity to importance is so vftah ,When fluent 
readers read* they are able to use textual cues and background knowledge , 
to help identify important elements in the tetft>~^ These important elements 
are fhen used to construct an internal representation of the author's 
message (Kintsch & van Dijk, 1978). Evi dence«presented earlier indicates 
that poor readers seem to have difficulty in us lp'<f~textual cues. Without, 
such guidance it must be very difficult to construct an accurate, organized 
representation of what the author intende4 to communicate* Furthermore, 
given the importance of organization in memory, the lack of such a repre- 
sentation should make it less likely that information will be remembered 
initially, more likely that ft will be forgotten in the interim, and less 
likely that it -will be retrieved wH'en needed (Meyer, 1977). ' • 

, The data presented in this study also provide<K?upport for the third %- 
hypothesis that poor reader^ fail to use, or use ineffectively, those 

summarizati-on rules used by more fluent readers* Th£se data replicate and 
i 

extend the results reported by Day (1980), Marshall and Glock (1978-79), 
and Tierney and Bridge (1979) which indicated that poor readers have 

; v m i* 
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difficulty integrating individual propositions fnto larger, uni ts. In 
addition, the finding that effective rule use accounted for a significant 
proportion of the variance in the summarization scores but not the" compre- 
hension scores indicates that this strategic skill is-more relevant to ' 
the task of summarizing than it is to the .more global process of compre- 
hension. , . * ^ 

The fact that effective rule use was more related to the summarization" 
scores fhan to the comprehension scores may help clarify the relationship 
between summarization and compreherision. One explanation is that the task 
of summarizing not only requires a reader to construct an internal 
representation of the "authors message, as is requi red for comprehension 
but also requires that other, secondary decisions be made about the relative 
importance of the elements in the internal representation (Brown & Day, 
Note 1; Johnson, 1978). Moreover,, it seems that these secondary operations 
require the act fve . coat rol of the reader to a much greater extent than do 
the comprehension processes which resulted in the internal representation 
initially. Poor' readers run into difficulty with both stages of this task. 
Mot only do they have difficulty in constructing an internal representation 
of the author's message, but they. also have difficulty in the secondary 
operations required to produce a summary. 

What educational implications can Be drawn from this study? ( The 
first comes from the finding that sensitivity to importance accounts for " * 
significant proportions of the variation in the children's comprehension . . 
scores. Teachers may wish, to ^ssess children's sensi.tivity to importance; 
when there is evidence of comprehension difficulties. The methods for this 
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assessment can be informal or formal. For example, simply asking the 
children about which information In the passage^ Is the most -Important and 

why they think so may provide useful diagnostic Information, A more formal 

# . » 

method of evaluation might involve procedures similar to those used in this 
study where children could bie asked to identify the* most Important 
sentences in a carefully selected test passage. The children's choices' 
could then be compared wi th norms" based on the choices of more fluent 
readers, or on results obtained from a theoretically based analysis of the 
text structure. In any case, teachers may find that some poor readers-may 
need explicit training in higher-order comprehension strategies in addition 
to or instead of training on decoding ski 1 Is. > It is important to stress 
this point because, until recently, it has always been easier to focus on > 
decoding problems since we have had a clearer, understand i ng of what decoding 
skills need to-be taught. This is not to imply that fluent decoding is not 
Important; certainly, it is. However, additional skills, particularly 
those that deal with understanding large units of text, need to be taught. 
The findings presented rn this study argue strongly that the ability to 
identify the important. elements in a passage should be included as one of 
those skills* An important question for future research will be to find 
some effective Instructional strategies for accompl ishing this goal* + 

A second implication, -closely related to, the first, comes from the 
finding that poor readers did show some consistency in the kinds of 
sentences that'they chose as important. Thjs impl ies /that wh I le. the 
sentences poor readers tended to select as important differed from those 
of adult and good readers, the selections were* not necessarily idiosyncratic, 

. 36 " :. ■ , 
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Rather, they seemed to be based on criteria other than those .used by fluent 
readers., It may be necessary to 4-eati* poor readers to develop different 
and possibly more discriminating criteria for deciding what is impdrtant ^ 
in a passage. Teachers may better facilitate this transition by showing 

greater sensitivity to the fact that what appears to be an incorrect 

^ r ' * 

selection given the perspective of the fluent reader, may in fact be a 

quite reasonable Choice given the perspective of the Vess'fluent or young 
reader. 

The third implication is based on the data which indicate that the 
task of, summarizing involves some strategies in addition to those, requi red 
for comprehension. Therefore, wherL children have trouble summarizing what ^ 
they have read, teachers should not automatically assume that the children 
are having difficulty in understanding What they have read. Although 
difficulties with the task of summarization may be symptomatic of compre- 
hension problems, summarization difficulties, are fiot necessarily confined 
to comprehension problems. It may be that some children's difficulties in 
summarization lie in the secondary operations iised to condense and transform 

£7 • * ^ 

,, . 0 

a passage Into its gist'. Thus, training these students in an attempt to 

Improve their general comprehension abilities may not improve their 

performance on the specific task requi rements .of summari zihg. 7 > • 

fn conclusion, this study has provided information which should be 
useful in determining some of the sources of higher-order comprehension^ 
problems evidenced by many poor readers. The results reported here should 
also help to emphasize the notion that there Ls more to reading comprehension 
difficulties than inadequate decoding skills and ,thgt there is more to. 
summarization than adequate comprehension. \ 
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Table 1 * 

Mean Correlations Between Qrofrp Mean Scores 
* for Various Tasks 



Group 



Group 

* 

* 




Poor Readers 






Good .Readers 






Adults 




Mean 
Importance 
Rating 


Importance 
Selection 


Summary 
Inclusion 


Mean 
' Importance- 
Rating 


Importance 
Selection 


Summary 
Inclusion 


'Mean « 
Importance 7 
Rating 


Importance 
Selection 


Summar/ 

Inclusion * 


Poor Readers 
















♦ » 




Mean Importance Rating 




.770 


.186 


.660 


.562 


.360 




* -.353 


* .301 ; 


Importance Selection 






.257 


. .557 ' 


.575 


.380 


" .366 


.326 


. .-28* 


Summary Inclusion 








;W 




.7*1 


.461 


.479 


\§87— \*. . 


Good Readers 




















Mean tmportaric'e Rating 










.808 

i 


.598 


.708 


.625 


.579 


Importance Selection 












-59J 


* .626 


- .659. " 


\ -sis-,; ; ' 


Summary Inclusion 














■ .62$' 


- .603 





Acjults 

Mean Importance Rating 
.Importance Selection' 



.838 



.750 
.729 . 



Note . Correlations are based on 224 sentences. * 

Group importance ratings are the mean rating given to each sentence. * , ^ 

Group importance selection is the proportion of subjects who Selected the sentence as one of thV'flve most Important,, 
Group summary inclusion is the proportion of subjects who Included the sentence In a summary. 
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Table 2 

Sentences Which Showed Significantly 
Different Importance Selection Patterns 
for Fluent and Less Fluent Readers 

* ' v CITIES IN THE 1800'S 

*ln the last years of the lSOfl's, cities in the United States were, 
growing faster than anyone had.ever d/eamed was possible. But as the 
cities grew, so did the problems. 

One problem was slums, with crowded, dirty apartment buildings called . 
tenements. In the slums, diseases spread quickly when people got sick.. J_n 
crowded slums, people threw their garbage out the windows, where it grew 
into huge heaps in the streets and alleys.. Insects and rats in the garbage 
caused more sickness in the slums. 

With sovmany people in cities,, garbage suddenly became a problem 4 
outside the slums. No one guessed that cities would ever have to find ways 
to collect the garbage. Why, even in New York, the biggest city in the 
country, garbage had always been eaten by pigs in the streets. ' 

New buildings went up almost overnight. Many were poorly made and 
Jan/ned close together. Most were made at least partly from wood. The 
"danger of fire increased. Cities began to suffer from terrible fires 'that 
quickly burned down entire neighborhoods. Chicago had one of the worst 
fires. Most of the city was destroyed and hundreds of people wgre killed 
or hurt . If cities were going to be made safe, buildings had to be made 
better, and good fire departments wefe needed. 

*Cr'ime was^another city problem: Oh, there had always been criminals. 
But like other people, criminals seemed to be especially attracted to the 
city. The only di ffererice was; that the criminals came for different _ r 
reasons. Large numbers of people and businesses provided more targets for 
thieves. And great crowds made criminals hard to catch. Sometimes a gang ' 
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Table 2 (cont.) 



S 



would take over a neighborhood In the city and even the police wefe afraid 
to go there * f )' ' . • 

Nearly everyone could see that-the' new cities needed help. *But many 
people believed that jt was not the job of the city government to solve the 
new problems like slums or garbage or crime. 

Note. Underlined sentences were selected as important by significantly 

* (p < .05) more poor readers than by good readers and adults. 
-— « 

'Sentences with asterisks were selected as important by significantly/ 
(p < .05) more good readers and adults than by poor readers. 
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Table. 3 



s 



Mean\Ratlngs by. Passage Quartlle for Sentences 
Included in Summaries and for Sentences Deleted 



Passage Quarti le 



Group 




1 




2 


3 


4 




Indus tons 


4,16 (.37) 




(.44) 


4.02- (.81) 


4.d6 C4o) • 


ADULTS 


Deletions 


3.38 (.36) 


3.33 


(..38) 


3.25 (.43) 


,3.34 (.42) 




Di fference 3 


•79 (-30) 


.63 


(.29) 


• 77 (.73)- . 


.72 (.29) 




Inclusions 


3-69 (.56) 


3.56 


(••56) 


3.67 (.56) 


3-56 (.73) 


GOOD READ&RS 


Deletions 


3-32 (.49) 


3-30 


(.46) 


3.23 (.47) 


3.36 (.45) 




Di f ference 


T 37 MS) 


.26 


(.31). 


v .44 (.50) 


.20 (.70) 




Inclusions 


3.3'* (-60) 


°3..35 


(.85) 


3.38- (1.09) 


3.12 (1.34) 


POOR READERS 


Deletions 


3.14 (.58) 


3-19 


(.49) 


3'.28. (.49) 


3.. 3P (-54) 




Di f ference 3 


.20 (.37) 


.16 


(.84) 


.11 (.95) 


n.18 (1.33). 



Note. N of cases* adults « 37} good readers = 39; poor readers 
Numbers in patenthesls are standard deviations.. 
a These are mean differences. 
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| \ - ' . '. Table k 

Partitioning of Variance of "Summarization 
• Scores and Tests of Significance 



Variable 


C 

r 


Percentage of 
VariaAc^ 


IPAT Culture Fair Id 


17.29*** 


16.9 2 * ' 


Decoding Speed 


<1 ' ' 


.05 


Decoding Accuracy 


1.50 


- 1,47 - 


Response Level Contrast 1 


1.66 


1 .6Z 


Response Level Contrast 2 


<1 


.04 


Sensitivity to Importance 


16.73*** 


16.40 


Proportion or trrecLive t\uie use 


U 23* 

*t. t-3" 


4.15 • 


IPAT x Decoding Spe^d * 
IPAT x Decodihg Accuracy 


, <1 


.08 


<1 


.04 


IPAT x Contrast 1 


1.20 


* - - 1". 18 # 


IPAT x Contrast 2 


<1 


.02 


IPAT x Sensitivity to Importance 


<1 




IPAT x Proportion of Effective Rule Use 


<1 


.20 


HornH inn ^tippH * DpfnHino ArruracV 


<1 


.19 


Decoding Speed x Contrast I 


<1 


.02 


Decoding Speed x Contrast 2 


1,48 


1.45 


Decoding Speed x Sensitivity to. 
Importance. 


<l 


• 79 


Decoding Speed x Rroportion of 
Effective- Rule Use 

Decoding Accuracy x Contrast 1> 


<l 




<l 


.85 


Decoding Accuracy x Contrast 2 


<l • 


.63. 


Decoding Accuracy x Sensitivity to 
Importance , 


<l 


.94 


Decoding Accuracy x Proportion of 
. Effective Rule Ose 


<1 


.97 
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Table 4 (cont.) 



W0 



Variable 



Percentage of 
Variance > , 



Contrast 1 x Sensitivity to 

Importance % <1 

Contrast 1 x Proportion of Effective 

Rule Use <1 

Contrast 2 x Sensitivity to Importance 3-23 

Contrast 2 x Proportion of Effective 

Rule Use 2.33 

Sensitivity to Importance x Effective 

Rule Use 1*1* 



• 36 

3.16 
2.28 
J. 09 



Note . H = 7k, R = .55. , • 

All independent variables , have one degree of freedom. 

*p_ < „05. » 

**£ < loos. 
***p < .0005. 
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Table 5 

Partitioning of Variance of Meaft Passage 
Comprehension Scores and Tests of Significance 



Variable 

i 


F 


Percentage .of 
Variance 


JPAT Culture Fair IQ 


9-09** 


9.30 


Decoding Speed 


<1 


.11 


Decoding Accuracy 


4. 83* 




Response Level Contrast 1 


<1 


. ' .01 


Response Level Contrast 2 


2.23' 


2.29 


Sensitivity to Importance 


5.16* % . 


: 5-31 


Proportion of Effecfcj ve Rule Use 




3-55 


IPAT x' Decoding Speed 


<i 


.i»6 


IPAT x Decoding Accuracy 


6.09* 


6.2/ 


IPAT x Contrast \ 


< i 


.05 


IPAT x Contrast 2 


< 1 




IRAT x Sensitivity to Importance 


<i 


• .13 


IPAT x Proportion of Effective 
Rule Use " 


<i ■ 




Decoding Speed x Decoding Accuracy 


2.65 


2.73 

1 


Decoding Speed x Contrast ,1 
Decoding Speed x Contrast 2 


2.79 
5'. 6h* 


2.87 
5.80 


Decoding Speed x Sensitivity to \ 
Importance 


1.53 


1.57 


Decoding Speed x Proportion of 
Effective Rule Use 


<1 




Decoding Accuracy x Contrast 1 


3* 83 




Decoding Accuracy x Contrast 2 


<1 




Decoding Accuracy x Sensitivity to 
Importance 


<1 


.01 
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. Table 5 


(ccint.) 




* * 


Variable 


F 




re rcen cage or 
Variance 


Decoding Accuracy x-Proportion of 
Effective Rule Use 


< 1 




♦ /o 


Contrast 1 x Sensitivity to Importance 


<1 




.28 


Contrast 1 x Proportion of Effective 
Rule Use 


<1 




.27 * 


Contrast % x Sensitivity to Importance 


<1 




• 93 


Contrast' 2 x Proportion of Effective 
. Rule Use 


<1 




.27 


' *> 
Sensitivity to Importance x Effective 
Rule Use 


<1 




•33 . 



Note . N = 7^^ R. * -53- 

All independent variables have one degree of freedom. 

*p < .05. 
**p < .005. 
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Table" 6 

> * 


. ■ \ 






Partitioning of Variance of Stanford Achievement 


Reading 


« 

• 


Comprehension Subtest Scores and Tests of Srgni f icance / , 


r 


Variable 


F 


Percentage of- 4 

War*? anrfl 
Vd 1 1 dllOc 


• 


JPAT Culture Fair IQ 


21.01** • • 


20.08 




Decoding Speed 


9.11** 


8.71 




Decoding Accuracy f 


3.71 


3.55 


• 


Response Level Contrast 1 


<1 


- .26 ' ■ 




Response Level Contrast 2 


2.23 


2.13 




Sensitivity to Importance 


5*65* 


5.40 . 


-* - 


Proportion of Effectiye Rule Use 


1.83 ' 


1.75 - • .. '*/: 




1PAT x Decoding Speed 


1 .93 


1 . 04 




1 PAT x Decoding Accuracy 


< i 

* * * 






(DAT" v> ^Anf K^r^f 1 

irAi x contrast i 




1 69 * 

| • U£ (v 




IPAT x Contrast 2 


' <l 


.67 " •" : 




IPAT. x Sensitivity to Importance 


r <1 


• .64 




A?M x Proportion of Effective Rule Use, 


1.60 


1.53 




Decoding Speed x Decoding Accuracy 


<1 


• * 19 




Decoding jSpeed x Contrast 1 


<1 


.09 




Decoding Speed x Contrast 2 






\ 


Deciding Speed x Selhsitivity to 
Importance * 


2.23, 


' 2.13 • 


- 4 


Decoding Speed x Proportion of 
Effective Rule Use 


<r 


f « 




Decoding Accuracy x Contrast 1 


r <1 


.04 • •• 




Decoding Accuracy x Contrast 2 


<1 ' ■ 


♦ 

.13 


> 


Decodinjg Accuracy x Sensitivity to 
Importance 

Decoding Accuracy x Proportion of 
Effective Rule Use 


. <-l . 


.87 • 




1 . 92 


* l .8*i • • ■ 




1 ■ " " . . % . 
• 
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... - • I ' 


Variable , , ' 


F 


Percentage of 
.. . Variance 

V 


Contrast J x Sejisi ti vl ty to Importance 

4 


' . ■ <1 


.31. • 


Contrast 1 x Proportion of Effective 
Rule Use 


^ <.i 


\ -08 


Contrast 2 x Sensitivity to Importance 


.<! 


•09 ,„ 


Contrast 2 x Proportion of Effective 
Rule Use 


, <l 


' X, - 82 ' 

K 12 • 4 

■ ' :> ' 


Sensitivity to Importance £ Effective 
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Note . N - 7*», R 2 = .56. - ' 

All independent "v^ lab les have one degree of freedom. 
.*£ < .05. r . **, ' ; 

**p < J0Q5,. • ' ." • 

*A*p < .0005-. - ^ • .• *• • ' " 
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Strategic Difficulties 
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4%*^ ' Figure Captions 



- Figure I. The proportion oj sentences from each passage quartile 
which were included'Tn the summaries, s 

Figure 2. The^fToportion of sentences from each passage quartile which 
was selected 5s the five mostf^ important. « 

Figure 3. Relative proportion of the use of the transformat ions. ~ . 
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Inventions 



Reproductions Run-on Combinations 
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